On-line educational system for processing exam questions and answers

ABSTRACT

An on-line educational system including exam processing and electronic journal features. An instructor builds a course on-line containing identification of assignments and educational materials, which axe compiled intO an on-line elcctronic syllabus. Users enrolled in the course may access the electronic syllabus and perform various functions with the on-line educational system in order to participate in the on-line educational course. Users can receive an on-line exam, having multimedia content, for the course, and they can electronically provide answers for the exam. Users can also enter information into an electronic journal and specify which portions of the journal the instructor may view.

The present application is a division of U.S. application Ser. No.09/384,458, filed Aug. 27, 1999, now U.S. Pat. No. 6,470,171 which isincorporated herein by reference as if fully set forth.

FIELD OF THE INVENTION

The present invention relates to a method and apparatus for providing anon-line educational system.

BACKGROUND OF THE INVENTION

The Internet has permitted users with web browsers to easily exchangeinformation over the Internet. Educational materials, for example, maybe distributed to users for taking an educational course on-line.Providing on-line educational courses requires various features in orderto successfully execute the course. In order for the course tosuccessfully replace or supplement in-classroom courses, users must beprovided with various features so that the on-line educational courseprovides certain benefits over in-classroom teaching.

Accordingly, a need exists for various features for an on-lineeducational system.

SUMMARY OF THE INVENTION

An apparatus for providing exam questions for use with an on-lineeducational system provides for on-line testing of users. Theeducational system includes providing on-line content concerningeducational materials for a particular educational course, and providingon-line an electronic syllabus for the educational course. The apparatusprovides on-line to the users exam questions with multimedia content,and receives on-line answers to the exam questions.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an on-line educational system.

FIGS. 1A-1M are flow charts of various methods for executing functionsin an on-line educational system.

FIG. 1A is a flow chart of a home page method.

FIG. 1B is a flow chart of a document sharing method.

FIG. 1C is a flow chart of an e-mail class method.

FIG. 1D is a flow chart of a gradebook method.

FIG. 1E is a flow chart of a message center method.

FIG. 1F is a flow chart of an on-line chat room method.

FIG. 1G is a flow chart of a journal method.

FIG. 1H is a flow chart of a notebook method.

FIG. 1I is a flow chart of a webliography method.

FIG. 1J is a flow chart of a threaded discussion method.

FIG. 1K is a flow chart of a grading method.

FIG. IL is a flow chart of administrative pages method.

FIG. 1M is a flow chart of a course manager method.

FIG. 2 is a diagram illustrating arrangement of FIGS. 2A-2R for adatabase map.

FIGS. 2A-2R are diagrams of a database map illustrating a relationaldatabase for an on-line educational system.

FIGS. 3A-3X are diagrams of screens permitting instructors, users, andothers to interact with an on-line educational system.

FIG. 3A is a diagram of a home page screen for an instructor.

FIG. 3B is a diagram of a home page screen for a user.

FIG. 3C is a diagram of a document sharing screen.

FIG. 3D is a diagram of an e-mail class screen.

FIG. 3E is a diagram of a gradebook screen for an instructor.

FIG. 3F is a diagram of a gradebook screen for a user.

FIG. 3G is a diagram of a message center screen.

FIG. 3H is a diagram of a chat room screen.

FIG. 3I is a diagram of a journal screen.

FIG. 3J is a diagram of a notebook screen.

FIG. 3K is a diagram of a webliography screen.

FIG. 3L is a diagram of a threaded discussion screen.

FIG. 3M is a diagram of a grading or exam screen.

FIG. 3N is a diagram of an administrative pages screen.

FIG. 3O is a diagram of an enrollment status screen.

FIG. 3P is a diagram of a user status screen.

FIG. 3Q is a diagram of an enrollment screen.

FIG. 3R is a diagram of a message screen.

FIG. 3S is a diagram of a user reports screen.

FIG. 3T is a diagram of a course reports screen.

FIG. 3U is a diagram of a university reports screen.

FIG. 3V is a diagram of a course manager screen.

FIG. 3W is a diagram of a course manager unit screen.

FIG. 3X is a diagram of an add content screen for a course manager.

DETAILED DESCRIPTION Overview

An on-line educational system provides for participation in on-lineeducational courses. Instructors build an educational course using anapplication referred to as a course manager in order to generate anelectronic syllabus. Examples of an electronic syllabus are providedbelow, and the term “electronic syllabus” refers to informationelectronically accessible and providing an indication of content for anon-line course or an indication of assignments for an on-line course.

The system posts the syllabus for the course on-line. Usersparticipating in the course use web browsers or other applications ontheir computers to view the syllabus and participate in the on-linecourse. The users interact with the instructor and other users in thecourse, and they submit information on-line, such as completion ofassignments. They also take exams on-line and receive grade informationon-line for the exams or completion of the assignments.

The term “system” is used to refer to an on-line educational system, anexample of which is described in the present specification. The term“database” is used to refer to a data structure for storing informationfor use by the system, and an example of such a data structure indescribed in the present specification. The term “user” refers to aperson participating in an on-line course, and the term “instructor”refers to a person teaching or otherwise providing content orinstruction for an on-line course. A person may be both a user and aninstructor. The term “assignments” refers to work to be completed by auser for an on-line course, and examples of assignments are providedbelow. Assignments may include work to be completed by a user withoutrequiring responsive information sent to an instructor, and they mayalso include work to be completed by a user requiring responsiveinformation. Assignments may also include or use learning tools.

The on-line system removes geographical and time-based boundaries foreducational courses. The users may log on to the system from anylocation having Internet or other network access in order to participatein the course. They may typically use the system at any time of the dayin order to obtain assignments, complete the assignments, take examson-line, and participate in on-line realtime and non-realtimediscussions. Likewise, instructors may use the system from any locationaccessible to the Internet or other network, and at any time, in orderto post assignments on-line, grade completion of assignments, andinteract on-line with users in realtime or non-realtime.

The on-line educational system also increases options and tools forteaching courses and participating in the courses. Instructors mayprovide traditional lectures in the form of recorded video or audioinformation provided on-line to users, and may also provide traditionalreading assignments by posting documents on-line for the users. Inaddition, they may provide many other types of teaching throughcomputer-based tools. They may participate in on-line realtimediscussions with users in an on-line chat room. They may interact withusers in non-realtime discussions by posting topics for discussion andlater posting comments on the discussion. By posting hypertext links,they may direct users to content on the Internet for research related toan educational course. Electronic journals permit users to enterinformation such as text related to the course, and an instructor canaccess the journal to review and comment on the information. Instructorsand users can send e-mail messages to others in the course.

The use of multimedia content provides for additional teaching tools.Instead of viewing only static information, users may view multimediacontent and potentially interact with it. Therefore, the terms“information,” “message,” “content,” and “materials” may include a widevariety of types of information such as, for example, video, audio,graphics, text, animations, multimedia, computer simulations, slideshows, and images; it may also include combinations of such information.

The system also permits electronic administrative functions. Usersthrough their computers can electronically enroll in courses, paytuition, inquire about financial aid, obtain technical support, obtaintranscripts, purchase text books, and visit an on-line library.

The system uses, for example, a relational database supporting screensthrough which users and instructors interact with the system. FIGS.3A-3X are screens illustrating how users and instructors may interactwith the system, and these screens may be displayed on display devicesassociated with the users' and instructors' computers. The term “screen”refers to any visual element or combinations of visual elements fordisplaying information; examples include, but are not limited to, userinterfaces on a display device or information displayed in web pages orin windows on a display device. The screens may be formatted, forexample, as web pages in HyperText Markup Language (HTML), or in anyother suitable form for presentation on a display device depending uponapplications used by instructors and users to interact with the system.

The screens include various sections, as explained below, to provideinformation or to receive information or commands. The term “section”with respect to screens refers to a particular portion of a screen,possibly including the entire screen. Sections are selected, forexample, to enter information or commands or to retrieve information oraccess other screens. The selection may occur, for example, by a using acursor-control device to “click on” or “double click on” the section;alternatively, sections may be selected by entering a series of keystrokes or in other ways such as through voice commands or use of atouch screen. In addition, although the screens shown in FIGS. 3A-3Xillustrate a particular arrangement and number of sections in eachscreen, other arrangements are possible and different numbers ofsections in the screens may be used to accomplish the same or similarfunctions of displaying information and receiving information orcommands. Also, the same section may be used for performing a number offunctions, such as both displaying information and receiving a command.

The processing to support the screens in FIGS. 3A-3X is shown in theflow charts of FIGS. 1A-1M. The processing may be implemented insoftware, such as software modules, for execution by computers or othermachines. The exemplary database structure to store information receivedthrough the screens and to display information in the screens is shownin the database map of FIGS. 2A-2R, which illustrate a relationaldatabase structure providing a particular arrangement of tables andassociations between them. FIG. 2 illustrates arrangement of FIGS. 2A-2Rfor the database map. Appendix A contains a data element dictionaryexplaining the structure of the relational database shown in FIGS.2A-2R. FIG. 1 illustrates exemplary hardware components to implement thesystem processing, screens, and database structure.

On-Line System

FIG. 1 illustrates an exemplary system 10 for implementing an on-lineeducational system. System 10 includes instructor machines 12 and 14connected with a network 40 such as the Internet or other network suchas any wide-area or local-area network. Instructors at instructormachines 12 and 14 may enter information to build and develop an on-lineeducational course and provide teaching for the course throughinteraction with their machines and a server 36. User machines 16 and 18are also connected with network 40. Users or students at user machines16 and 18 interact with one or more instructors at instructor machines12 and 14, with users at other user machines, and with server 36 inorder to participate in one or more on-line educational courses.

Server 36 is connected with network 40 and may be used by instructormachines 12 and 14, and user machines 16 and 18, to store informationfor educational courses and provide content or other information for thecourses. System 10 may also include the ability to access one or moreweb site servers 38 in order to obtain content from the World Wide Webfor use with educational courses. Only two instructor machines and usermachines are shown for illustrative purposes only; system 10 may includemany instructor machines and user machines and may be scalable to add ordelete instructor or user machines to or from the network.

User machine 16 illustrates typical components of a user or instructormachine. User machine 16 typically includes a memory 20, a secondarystorage device 30, a processor 32, an input device 34, a display device28, and an output device 26. Memory 20 may include random access memory(RAM) or similar types of memory, and it may store one or moreapplications 24, and a web browser 22, for execution by processor 32.Secondary storage device 30 may include a hard disk drive, floppy diskdrive, CD-ROM drive, or other types of non-volatile data storage.Processor 32 may execute applications or programs stored in memory 20 orsecondary storage 30, or received from the Internet or other network 40.Input device 34 may include any device for entering information intomachine 16, such as a microphone, digital camera, video recorder orcamcorder, keyboard, cursor-control device, or touch-screen. Displaydevice 28 may include any type of device for presenting visualinformation such as, for example, a computer monitor or flat-screendisplay. Output device 26 may include any type of device for presentinga hard copy of information, such as a printer, and other types of outputdevices include speakers or any device for providing information inaudio form.

Web browser 22 is used to access information for an on-line educationalcourse and display it in web pages, and examples of those pages areshown in the screens provided in FIGS. 3A-3X. Examples of web browsersinclude the Netscape Navigator program and the Microsoft InternetExplorer program. Any web browser or other application capable ofretrieving content from a network and displaying pages or screens may beused.

Instructor machines 12 and 14, and user machine 18, may include the samecomponents as user machine 16. Therefore, examples of user or instructormachines for interacting with an on-line educational system includepersonal computers, laptop computers, notebook computers, palm topcomputers, network computers, or any processor-controlled device capableof executing a web browser or other type of application for interactingwith the system.

Server 36 typically includes a memory 42, a secondary storage device 50,a processor 52, an input device 54, a display device 48, and an outputdevice 46. Memory 42 may include random access memory (RAM) or similartypes of memory, and it may store one or more applications 44 forexecution by processor 32. Secondary storage device 50 may include ahard disk drive, floppy disk drive, CD-ROM drive, or other types ofnon-volatile data storage. Processor 52 may execute one or moreapplications or programs stored in memory 42 or secondary storage 50, orreceived from the Internet or other network 40. Input device 54 mayinclude any device for entering information into server 36, such as amicrophone, digital camera, video recorder or camcorder, keyboard,cursor-control device, or touch-screen. Display device 48 may includeany type of device for presenting visual information such as, forexample, a computer monitor or flat-screen display. Output device 46 mayinclude any type of device for presenting a hard copy of information,such as a printer, and other types of output devices include speakers orany device for providing information in audio form.

Server 36 stores a database structure in secondary storage 50, forexample, for storing and maintaining information for on-line educationalcourses. An example of that database structure is the relationaldatabase shown in FIGS. 2A-2R. Although a relational database is shown,other types of database structures may be used, such as anobject-oriented database. Processor 52 may execute one or moreapplications 44 in order to provide the functions shown in the flowcharts of FIGS. 1A-1M and to provide the web pages shown in the screensof FIGS. 3A-3X. Although only one server is shown, system 10 may usemultiple servers as necessary or desired to support the users andinstructors and may also use back-up or redundant servers to preventnetwork downtime in the event of a failure of a particular server.

Examples of servers include, but are not limited to, Intel-basedHewlett-Packard servers configured into clusters, or a clone utilizingIntel processors and motherboards. Examples of systems for implementingand managing the relational database of FIGS. 2A-2R include, but are notlimited to, the Microsoft SQL server and storage products by I.I.S.Intelligent Information Systems Limited.

Although machines 16 and server 36 are depicted with various components,one skilled in the art will appreciate that these machines and theserver can contain additional or different components. In addition,although aspects of an implementation consistent with the presentinvention are described as being stored in memory, one skilled in theart will appreciate that these aspects can also be stored on or readfrom other types of computer program products or computer-readablemedia, such as secondary storage devices, including hard disks, floppydisks, or CD-ROM; a carrier wave from the Internet or other network; orother forms of RAM or ROM. The computer-readable media may includeinstructions for controlling a computer system, such as machine 16 andserver 36, to perform a particular method.

Home Page

FIG. 1A is a flow chart of a home page method 60 for an on-lineeducational system. FIG. 3A is a diagram of a home page screen 800 foran instructor, and FIG. 3B is a diagram of a home page screen 842 for auser, both of which support home page method 60.

As shown in FIG. 3A, home page screen 800 includes an identification 802of an instructor, and identification of users 804 enrolled in aparticular course. A syllabus section 806 specifies an on-lineelectronic syllabus, and it identifies units in a units section 808 fora particular course, titles in a titles section 810 for the units, andassignments or content in a content section 812 for the units. A keysection 814 identifies the type of content or assignments in contentsection 812; as shown, key section 814 may use icons or other symbolsfor identifying the assignments or content for particular units in unitssection 808. Content identified in content section 812 may provide anindication of educational materials, possibly including assignments, fora course. The indication may be provided in a number of ways such asthrough use of icons, as shown, or alternatively by displayed text,links, graphics, multimedia, or any type of displayed information. Also,the indication need not be in the electronic syllabus as shown; it mayalternatively be provided elsewhere on a particular screen. Although anelectronic syllabus is shown in syllabus section 806, an electronicsyllabus may be accessed and presented in other ways such as, forexample, through selection of a icon, in one or more pull-down menus,within a displayed window, or in a separate screen.

An index section 816 permits an instructor or other person to selectother screens and functions by selecting the appropriate link. Forexample, index section 816 includes the following selections, all whichare further explained below. A course home page selection 818 provides atypical starting or home page for viewing upon logging on by aninstructor. A document collaboration selection 820 provides for documentsharing or collaboration, which involves the ability of users andinstructors to exchange documents and include messages when exchangingthe documents. An e-mail class selection 822 provides for the ability tosend e-mail messages to other users or instructors or both.

A gradebook selection 824 provides for access to an on-line gradebook,which is a screen accessible on-line and providing grade information.The gradebook includes a user view in which users view only gradeinformation for their respective assignments. The term “gradeinformation” refers to information relating to an instructor's or otherperson's evaluation of completion of assignments by users or otherinformation submitted by users as part of an on-line course. Gradeinformation may include, but is not limited to, comments, evaluations,letter grades, points, and scores. Grade information may include orincorporate any of the types of information identified above.

A message center selection 830 provides for the capability to sendmessages to users. In particular, the term “message center” refers to ascreen available to administrative or other authorized personspermitting them to electronically send messages to users for particularcourses at a course-level or to users for multiple courses at auniversity-level.

An on-line chat room selection 832 provides for users and instructors tointeract in a chat room. The term “chat room” refers to a screen inwhich a group of users and/or instructors may electronically postmessages for viewing in realtime by other members of the group.

A user journal selection 834 provides the ability of users to storeinformation concerning assignments for viewing by an instructor. Thus ajournal (or user journal) is an area in which a user may electronicallystore information concerning the assignments or related to a course, theinformation being electronically accessible to an instructor so that theinstructor may view the information and potentially include commentsabout it. The journal typically includes textual information; however, auser may enter any type of information identified above for viewing byan instructor.

A notebook selection 836 provides users to access areas in which theymay electronically enter information such as notes concerning a course.A notebook feature is similar to the journal except that the notebook isintended, for example, as an area where users may keep notes or otherinformation for their own purposes and not necessarily for viewing bythe instructor.

A webliography selection 838 provides a webliography feature. Thisfeature, as explained below, permits users and instructors to save linksto information concerning particular topics. It essentially involves away for users and instructors to collectively compile research or otherinformation.

An instructor gradebook selection 840 provides access to an instructorview of the gradebook by instructors or others granted access to it.This view provides grade information for all users in a particularcourse. In addition, instructors may enter grade information in thegradebook for viewing by the users who submitted completion ofassignments to the instructor for a particular course.

A threaded discussion selection 841 provides access to a threadeddiscussion feature. This feature permits non-realtime discussion oftopics. An instructor may enter a topic for discussion, and users mayenter comments about the topic in non-realtime for further comment byother users or the instructor.

Index section 816 also includes a help desk selection 826 and a policiesand procedures selection 828. Help desk selection 826 may provide aon-line connection with a help desk for receiving technical or otherassistance in using the system. Policies and procedures selection 828may provide information concerning policies governing use of the systemor procedures for using the system.

FIG. 3B is a diagram of a home page screen 842 for a user. Home pagescreen 842 includes an identification 844 of an instructor for aparticular course, and an identification 846 for a user and course. Homepage screen 842 also includes syllabus section 806 with units in unitssection 808, titles in titles section 810, and assignments or content incontent section 812 for a particular educational course, as shown alsoin home page screen 800. The content of syllabus section 806 may changedepending upon each particular course. Home page screen 842 alsoincludes an index section 844 having selections as identified above inindex section 816, except that home page screen 842 may not necessarilyhave all selections available to instructors. For example, as shown,index section 844 does not include an instructor gradebook selection 840so that users do not have access to grade information of other users.Home page screen 842 may also include a threaded discussion selection841. Selections available to instructors and users may vary dependingupon particular system requirements.

In method 60 (FIG. 1A), the system receives a log-on request by a user(step 62). The log-on request may include, for example, a user's orinstructor's name or other identifying information along with anoptional password. The system determines if the log-on is from aninstructor or from a user, which may be determined by comparinginformation in the log-on request with information the databaseidentifying authorized users and instructors (step 64). If an instructorlogs on, the system displays an instructor view of a course home pagesuch as home page screen 800 (step 68). Otherwise, the system displays auser view of a course home page such as home page screen 842 (step 66).The home page is typically presented in a web browser on a user orinstructor machine and constitutes a main page for an on-lineeducational system from which a user or instructor may execute variousfunctions.

The system determines if the instructor user is permitted access to theon-line educational system (step 70). If access if not permitted, thesystem may display an error message (step 72). Otherwise, if theinstructor or user is permitted access, the system displays anelectronic syllabus in syllabus section 806 for a selected educationalcourse and also displays an indication of content concerning educationalmaterials for the course (step 74). The system may optionally permitunlimited access, or permit any user to access the syllabus but restrictaccess to other on-line content. Also, the system may alternativelyrestrict access at an instructor's or user's request to log on to thesystem. Information stored in the database, as identified in the dataelement dictionary provided in Appendix A, may be used to restrictaccess to particular items in the system such as the electronic syllabusor portions of it.

The system then receives a requested function or feature by the user orinstructor (step 76). The system executes the function (step 78). Thesystem continually executes functions entered by the user or instructoras they interact with the system until it detects a log-off request(step 80). Upon receiving the log-off, the system may close the coursehome page. Since the system uses a relational database, for example, aninstructor or user may interact with the system in a variety ofdifferent ways. FIGS. 1B-M illustrate various functions that the systemmay execute upon request by an instructor or user.

Document Sharing

A document sharing feature of the on-line educational system permitsusers to provide a document to an instructor. The educational systemincludes providing on-line content concerning educational materials fora particular educational course, and providing on-line an electronicsyllabus for the educational course. The apparatus receives aneducation-related document from a particular one of the users andassociates a message with the document based upon information entered bythe particular user. The apparatus stores the document with the messagefor accessibility by the instructor. An education-related document isany document used as part of an on-line course.

Another document sharing feature of the on-line educational systempermits an instructor to provide a document to users. The educationalsystem includes providing on-line content concerning educationalmaterials for a particular educational course, and providing on-line anelectronic syllabus for the educational course. The apparatus receivesan education-related document from the instructor along with anidentification of a particular one of the users as an intended recipientof the document, and it associates a message with the document basedupon information entered by the instructor. The apparatus stores thedocument with the message for accessibility by the particular user.

The document sharing features may include additional aspects. They maynotify the instructor or the particular user of the document. They mayalso display an identification of the document and an indication of asource of the document, such as a name of the user or instructor whoposted the document. The received document may include text, audio,video, graphics, or multimedia information. The apparatus may alsoreceive a command related to manipulation of the document and executethe command. The commands may include, for example, sorting the receiveddocument or restricting particular access to it.

A document sharing screen electronically displays information for use byusers in sharing a document in the on-line educational system. Thescreen includes an index section for selecting a home page screen havinga content section identifying on-line content concerning educationalmaterials for a particular educational course and having a syllabussection for providing an electronic syllabus for the educational course.A receive section in the screen receives an education-related documentfrom a particular one of the users and associates a message with thedocument based upon information entered by the particular user. A storesection in the screen indicates storage of the document with the messagefor accessibility by an intended recipient of the document. The documentsharing screen may also include a notify section for use in notifyingthe intended recipient of the document when the screen is accessed bythe intended recipient.

FIG. 3C is a diagram providing an example of a document sharing screen848. Document sharing screen 848 has index section 816 as explainedabove. It also include a store or notify section 850 for providing anindication of and downloading a document to be shared. Store section 850includes a name section 852 identifying the document or file name, amessage section 854 specifying a message for the document, a section 856identifying the sender or source of the document, a date section 858identifying a date of posting the document, and a section 860identifying the document size. Document sharing screen 848 also includessections for sharing a document, including a receive section 862 foridentifying a document or file to be shared, a browse section 863 foruse in identifying a document or file to be shared, a message section864 for entering a message for the document, a section 866 specifyingthe originator of the document, and a date section 868 specifying a datefor the document. By selecting upload section 870, the user posts thedocument for sharing with an intended recipient. The intended recipientis the user who shared the document identified in section 850, or a usermay enter identification of an intended recipient.

FIG. 1B is a flow chart of a document sharing method 82, using documentsharing screen 848, for an on-line educational system. Document sharingmethod 82 may use at least the Table 690 in the database. Documentsharing permits an instructor and user to share documents relating to anon-line educational course. An instructor or user selects documentsharing selection 820 from the home page (step 84). The systemdetermines if a document is pending for the instructor or user (step86). If a document is pending, the system retrieves the document fromthe database and displays a document identifier such as is shown instore section 850 with any message information and the source of thedocument such as is shown in message section 854 and section 856 (step88). The source of the document is an identification of the user orinstructor who provided it for sharing or collaboration. The documentidentifier may be represented by an icon or other information forselection by the instructor or user. The source of the documenttypically constitutes the identification of the instructor or user whostored the document for sharing.

The system may then receive a command by the instructor or user tomanipulate the document (step 90). The system executes the command anddetermines if it is a sort command (steps 92 and 94). If it is a sortcommand, the system sorts the document (step 96). Sorting may includeorganizing the document among a plurality of stored or shared documentsaccording to particular criteria, such as alphabetizing them. Otherwise,the system executes the other command entered (step 98). Other commandsmay include, for example, opening the document. In addition, a user orinstructor may locally store the document.

The system also determines if the instructor or user desires to share adocument (step 100). The system receives the document or anidentification of it in receive section 862 (step 102). A user orinstructor may identify a document or file to be shared by selectingbrowse section 863, which may display a section or window listing filessuch as files saved by the user or instructor who desires to share adocument. The user or instructor may then select a displayed documentusing a conventional open document command, for example, after which apath to the storage location of the selected document appears in receivesection 862.

The system also receives any message information in message section 864such as is shown in message section 854 and associates the messageinformation with the document (step 104). The user or instructor mayenter message information in message section 864 by entering a textmessage using a keyboard or by entering any other type of informationusing an input device; message section 864 may contain the actualmessage or an indication of it. The message may be associated with thedocument in a number of ways. It may be incorporated in the document,attached to the document, stored with the document, identified by a linkor address, or identified in connection with the document.

The system also receives recipient information identifying theinstructor or user with whom the document is to be shared (step 104).The recipient information may by default be the instructor and all usersfor the course; alternatively, a recipient information may be selectedfrom a menu or section listing users and instructors in the course, orthe recipient may be the user or instructor who shared a previousdocument as identified in section 856.

The system stores the document with the message information in thedatabase along with source and recipient information (step 106). As thesystem knows the identification of the instructor or user who enteredthe document, the system may associate that information with thedocument or document identifier. The system receives the share requestthrough selection of upload section 870, and it transmits theidentification of the document to the recipient(s) so that therecipient(s) may detect when the document is pending (step 108).

E-Mail Class

FIG. 3D is a diagram of an e-mail class screen 872. E-mail class screen872 includes index section 816 as described above and also includessections for typical e-mail functions. In particular, e-mail classscreen 872 includes a section 874 for identifying intended recipients ofan e-mail message such as all users for a particular course or selectedusers identified by retrieving a menu listing the users. E-mail classscreen 872 also includes a section 876 identifying the sender of thee-mail message. The sender may use a subject section 878 to enter asubject for the e-mail message, a message section 880 to enter themessage, and an attachment section 882 to identify an attached file. Byselecting a send section 884, the system sends the e-mail message, ifrequired information was entered.

FIG. 1C is a flow chart of an e-mail class method 110, using e-mailclass screen 872, for an on-line educational system. E-mail class method110 may use at least Tables 542 and 598 in the database. In method 110,the system detects that the instructor or user selects e-mail classselection 822 in the course home page (step 112). The system displays ane-mail section such as screen 872, permitting the user or instructor toenter an e-mail message in subject section 878 and message section 880,along with the intended recipient(s) in section 874 (step 114). Thesystem receives message information and identification of a recipient,possibly with an attachment identified in attachment section 882 (step116). It also receives a send request by selection of send section 884(step 118).

The system determines if the required information is entered such asidentification of at least one recipient (step 120); if not, it maydisplay an error message (step 122) and allow the user or instructor toenter the required information. Otherwise, the system stores the messagein the database and transmits the identification of the message to therecipients (step 124). The recipients may thus upon logging onto thesystem detect that a message is pending for them.

On-Line Gradebook

An on-line gradebook feature of the on-line educational system permitsinstructor posting of and users' access to on-line grade information.The educational system includes providing on-line content concerningeducational materials for a particular educational course, and providingon-line an electronic syllabus for the educational course. The apparatusreceives from the instructor grade information relating to users'assignments for the educational course and posts the grade informationin an on-line gradebook.

The on-line gradebook feature may include other aspects as well. Forexample, it may permit each user to access the on-line gradebook andrestrict each user's access of information in the on-line gradebook toinformation corresponding to each particular user's completion of theassignments. The on-line gradebook also may selectively restrict eachuser's access to the grade information concerning each particular user'scompletion of the assignments. The gradebook may also be presented invarying types of views on a display device. An instructor view of theon-line gradebook provides the instructor with access to the gradeinformation for all of the users. A user view provides each user theaccess to their particular grade information.

A gradebook screen electronically displays information for use by aninstructor in providing an on-line gradebook in the on-line educationalsystem. The screen includes an index section for selecting a home pagescreen having a content section identifying on-line content concerningeducational materials for a particular educational course and having asyllabus section for providing an electronic syllabus for theeducational course. A receive section in the screen receives from theinstructor grade information relating to users' assignments for theeducational course, and a gradebook section in the screen posts thegrade information in an on-line gradebook.

The gradebook screen may also include a grade information section forpermitting each user to access the on-line gradebook and for use inrestricting each user's access of information in the on-line gradebookto information corresponding to their completion of the assignments.

FIG. 3E is a diagram providing an example of a gradebook screen 886 foran instructor. Gradebook screen 886 includes index section 816, in thisexample only including a selection to return to home page screen 800.Gradebook screen 886 also includes a user section 888 identifying usersfor a particular course. A gradebook section 890 permits an instructorto enter and post grade information for the users' assignments. Inparticular, each column in gradebook section 890 represents anassignment, as identified, and each row includes grade information forthe assignments for a particular user. Gradebook screen 886 alsoincludes a set up section 892 permitting the instructor to set up thegradebook by adding assignments and entries.

FIG. 3F is a diagram of a user gradebook screen 894 for a particularuser. Unlike gradebook screen 886 for an instructor, users typicallyonly have access to grade information concerning their own completion ofassignments. Therefore, user gradebook screen 894 includes a usersection 896 identifying the particular user, and a grade informationsection 898 identifying grade information for the user's assignments.Although only one assignment is shown, grade information section 898 mayidentify multiple assignments and corresponding grade information.Sections 900 permits the user to select their work in other areas. Also,user gradebook screen 894 includes index section 816 for selection bythe user to return to home page screen 842.

FIG. 1D is a flow chart of a gradebook method 126, using gradebookscreen 886 and user gradebook screen 894, for an on-line educationalsystem. Gradebook method 126 may use at least the following tables inthe database: Tables 580, 612, 622, 642, 644, 646, 648, 650, 674, 678,and 684. In method 126, the instructor or user selects gradebookselection 824 or 840 in the course home pages (step 128). The systemdetermines if an instructor selected the gradebook selection (step 130).If so, the system displays gradebook screen 886 for all users for aparticular course (step 132).

The system detects whether the instructor enters grade information intothe gradebook such as in gradebook section 890 (step 134). The gradeinformation typically relates to user's completion of assignments for aparticular educational course. Upon receiving grade information, thesystem receives and stores in the database grade information andassociates it with the relevant users as shown in gradebook section 890(step 136). By storing the grade information, the system posts the gradeinformation in an on-line gradebook for access by users as shown ingrade information section 898 for one particular user. The system alsodetects whether the instructor enters information restricting access tothe grade information (step 138). If the instructor enters accessinformation, the system receives and stores the access information forthe relevant grade information and restricts access accordingly (step142). Otherwise, the system may store default access information (step142).

With access restrictions, an instructor may identify particular gradeinformation for which access is restricted, and an instructor may wantto restrict access during particular time periods of the course. Thesystem may restrict the access by storing in the database an indicationof the limitation on access associated with the restricted information.Default access may include, for example, providing users with access tothe grade information for the completion of their assignments when it isposted by the instructor.

If a user had selected gradebook selection 824 (step 130), the systemdisplays user gradebook screen 894 for the user (step 144). The systemdetermines if the user is permitted access to the grade information(step 146). If permitted access, the system displays grade informationfor the particular user as shown in grade information section 898 (step148). Grade information section 898 is typically configured to onlyretrieve and display grade information corresponding to the useraccessing gradebook screen 894, and the system thus may restrict eachuser's access in gradebook screen 894 to only grade informationconcerning their own completion of assignments. If not permitted access,the system may selectively withhold from grade information section 898the restricted information.

Message Center/Administrative Message Center

A course-level message center feature of the on-line educational systempermits the posting of on-line messages to users for particular courses.The educational system includes providing on-line content concerningeducational materials for a particular educational course, and providingon-line an electronic syllabus for the educational course. The apparatusreceives a message concerning the educational course and posts anindication of the message for on-line accessibility of the message bythe users.

An administrative message center feature of the on-line educationalsystem permits the posting of messages to users for multiple courses.The educational system includes providing on-line content concerningeducational materials for a plurality of educational courses, andproviding on-line a plurality of electronic syllabuses for theeducational courses. The apparatus receives a message concerning theplurality of educational courses and posts an indication of the messagefor on-line accessibility of the message by all of the users.

A message center screen electronically displays information for use inproviding messages to users for the on-line educational system. Thescreen includes an index section for selecting a home page screen havinga content section identifying on-line content concerning educationalmaterials for a particular educational course and having a syllabussection for providing an electronic syllabus for the educational course.An input section in the screen receives a message concerning theeducational course, and a message section in the screen posts anindication of the message for on-line accessibility of the message bythe users.

FIG. 3G is a diagram providing an example of a message center screen902. Message center screen 902 includes index section 816 as explainedabove. Message center screen 902 also includes a message section 904 fora user to receive a message, and message section 904 may include anindication of a message for retrieval by the user or the actual message.A post section 906 permits posting of a message in the message center bythose authorized to do so. The message center is typically used only byan instructor or an authorized administrative person post messages at acourse-level for all or selected users in a course or at auniversity-level for all users in all courses or for selected usersamong selected courses.

FIG. 1E is a flow chart of a message center method 150, using messagecenter screen 902, for an on-line educational system. The message centerpermits posting of messages for users in a particular course or usersamong multiple courses. Message center method 150 may use at leastTables 542 and 598 in the database. In method 150, an instructor or userselects message center selection 830 in the course home page (step 152).The system determines if a message is pending (step 154) and, if so, ifretrieves the message from the database and displays the message or anindication of it in message section 904 (step 156). The systemdetermines if it receives a post message request through selection ofpost section 906 (step 158) and whether an instructor or otherauthorized person requested to post a message (step 160). The system maystore in the database a list of authorized persons and compare anidentification of the person requesting to post a message with the listin order to determine whether to allow the person to post a message.

In this exemplary embodiment, only instructors or other authorizedpersons are permitted to use the message center to post a message.However, users may optionally be provided access to that function aswell. If an instructor or other authorized person requested to post amessage, the system displays an input section, permitting the instructorto enter information for posting of a message (step 162). The inputsection may be similar to sections 874, 876, 878, and 880 in e-mailscreen 872, or it may be a section such as message section 904.

The system receives message content and the post message command (steps164 and 166). It may receive the content for the message andidentification of the recipients in the same manner as described withrespect to sections 874, 876, 878, and 880 for sending an e-mailmessage. A command to post a message may be entered through selection ofa post section 905. The system stores the message in the database andposts an indication of the message on-line for access by the users inthe particular course or among multiple courses (step 168). Theindication may include an icon or other identify, or it may include themessage itself.

On-Line Chat Room

FIG. 3H is a diagram of a chat room screen 906. Chat room screen 906 hasindex section 816 as explained above. Chat room screen 906 also has amessage section 908 for a user to view messages entered into a chatroom, essentially in realtime. A member section 910 identifies membersof the chat room permitted to view and enter messages appearing inmessage section 908. A user may enter a message in an input section 912and post the message in message section 908 by selecting a send section914.

FIG. 1F is a flow chart of an on-line chat room method 174, using chatroom screen 906, for an on-line educational system. In method 170, thechat room provides functions for users to interact in realtime bytransmitting messages into common message section 908 for presentationin chat room screen 906 displayed to each member of the chat room asidentified in member section 910. An instructor or user selects chatroom selection 832 in the course home page (step 172). In response, thesystem displays chat room screen 906 and adds the instructor or user asa member of the chat room in member section 910 (step 174).

The system then receives messages and transmits and displays themessages to members of the chat room as the chat room is displayed tothem in chat room screen 906 (steps 176 and 178). The system continuallyreceives and posts the messages until a particular instructor or usercloses chat room screen 906 or message section 908 (step 180). Inresponse to the instructor or user closing the chat room section, thesystem removes the instructor or user as a member of the chat room inmember section 910 displayed to the remaining members of the chat room(step 182).

User Journal

An electronic journal feature of the on-line educational system permitsa user to enter information relating to a particular course for optionalreview by an instructor. The educational system includes providingon-line content concerning educational materials for a particulareducational course, and providing on-line an electronic syllabus for theeducational course. The apparatus provides an electronic journal for aparticular one of the users permitting the particular user to enterinformation into the electronic journal. The apparatus also permits theinstructor to enter information into the electronic journal for viewingby the particular user.

The electronic journal feature may include additional aspects. Forexample, it may permit the user to selectively identify permitted accessto the electronic journal by the instructor. If the user identifiespermitted access, it selectively provides access to the electronicjournal by the instructor based upon the particular user'sidentification of permitted access. The user may group the informationentered into the electronic journal into particular entries, identifypermitted access by the instructor for each of the entries, and displayan indication of at least one of the entries. The user may enter varioustypes of information into the journal, or edit previously-enteredinformation, and such information may include text, audio, video,graphics, or multimedia information. The journal may also provide fordisplaying an indication of the instructor-entered information in orderto distinguish it from the user-entered information. For example, it maybe displayed in a different color, font, or background color, or withother distinguishing characteristics such as displaying it in a box.

A journal screen electronically displays information for use inproviding an electronic journal to users in the on-line educationalsystem. The screen includes an index section for selecting a home pagescreen having a content section identifying on-line content concerningeducational materials for a particular educational course and having asyllabus section for providing an electronic syllabus for theeducational course. A journal section in the screen provides anelectronic journal for a particular one of the users permitting theparticular user to enter information concerning the educational course.A comment section in the screen permits the instructor to enterinformation into the electronic journal for viewing by the particularuser.

The journal screen may also include an access section, associated withthe journal section, permits the user to selectively identify permittedaccess to the electronic journal by the instructor and selectivelyprovides access to the electronic journal by the instructor based uponthe particular user's identification of permitted access.

FIG. 3I is a diagram providing an example of a journal screen 916.Journal screen 916 has index section 816 as explained above. Journalscreen 916 has sections for providing an electronic journal. Selectionof a section 918 permits a user to start a new entry for the journal. Anentry is a definable portion of the journal. For example, each time auser enters new information in the journal, a new entry may be createdidentifying the entered information by a date and time the user enteredit. Alternatively, a user may modify previous entries, or create entriesbased upon other criteria, such as creating a new entry every week, fordifferent topics, or for different assignments.

Selection of sections 920 permits the user to view an expanded orcollapsed view of the journal entries. Entry section 922 displays aparticular one of the journal entries. Section 924 indicates when theentry displayed in entry section 922 was last modified. A section 926permits a user to enter information into the entry, and a commentsection 928 permits the instructor to enter information into the entry.Selection of an edit or access section 930 permits editing of the entrycontent or access to it. As shown, section 926 and comment section 928may be combined together with the instructor's comments identified, orseparate displayed sections may be used for the user's and instructor'sentered information.

FIG. 1G is a flow chart of a journal method 184, using journal screen916, for an on-line educational system. Journal method 184 may use atleast the following tables in the database: Tables 634, 636, 638, and640. The journal permits the user to enter information, possibly asrequired or requested by an instructor or an on-line course, and inadditional permits the instructor to access the information in order toprovide the user with coaching or feedback, or otherwise monitor andevaluate the user's progress.

In method 184, an instructor or user selects journal selection 834 inthe course home page (step 186). In response, the system displays ajournal section such as is shown in journal screen 916 (step 188). Thesystem determines if an instructor requested the journal function (step190). If so, the instructor identifies a particular user and relevantjournal entry and enters that information (step 208). A section, such assection 804 in the home page, may be displayed in order to permit aninstructor to select identification of a user.

The system determines if the instructor is permitted access to therequested journal entry (step 210). If permitted access, the systemdisplays the entry such as is shown in entry section 922 (step 212). Thesystem also detects whether the instructor enters information into theuser's journal (step 214) and, if so, the system receives and stores theentered information in the database for the user's journal such as isshown in comment section 928, optionally with a different appearancethan the user-entered information (step 216). The instructor then closesthe entry (step 218).

The instructor-entered information may be identified in a number ofways. It may be preceded by an indication of instructor-enteredinformation. It may have a different appearance in comparison to theuser-entered information such as by using reverse video, a differentcolor, font, underlining, bold, italics, or highlighting. Also, it maybe enclosed within a box or have other distinguishing environmentalfeatures. If the instructor entered multimedia information, theinformation may be distinguishable from the user information based uponaudio or video features, for example.

If a user had requested journal selection 834 (step 190), the systemdisplays journal screen 906 and determines if the user retrieves anexisting entry by manipulating section 920 to view and select an entry(step 192). If not, the system creates a new journal entry through theuser's selection of section 918 (step 196); otherwise, the systemretrieves the requested entry from the database (step 194). The user maythen enter information into the journal entry in entry section 922 oredit previously-entered information and close the entry (step 198).

The system also detects whether the user enters particular accessinformation through edit section 930, for example (step 200). The systemreceives the access information and restricts access to the journalentry according to the user-entered information (step 202). Otherwise,if the user does not enter access information, the system may assigndefault access to the journal entry in entry section 922 (step 204). Thesystem stores the journal entry with the access information in thedatabase for the user's journal (step 206). With access restrictions, auser may identify particular entries for which access is restricted, andthe user may want to restrict access during particular time periods ofthe course. The system may restrict the access by storing in thedatabase an indication of the limitation on access associated with therestricted information. Default access may include, for example,providing an instructor with access to the content of a journal entrywhen it is created and saved by the user.

Notebook

The notebook is similar to the electronic journal except that aninstructor typically does not have access to the notebook and it isprovided as an area where the users may enter notes or other informationfor their own use. FIG. 3J is a diagram of a notebook screen 932.Notebook screen 932 has index section 816 as explained above. A entrysection 934 permits a user to enter notes or other information, and thenotes or information are saved in the users notebook upon selection ofsection 936.

FIG. 1H is flow chart of a notebook method 220, using notebook screen932, for an on-line educational system. Notebook method 220 may use atleast Table 620 in the database. In method 220, the user selectsnotebook selection 836 in the course home page (step 222). In response,the system displays a notebook section such as notebook screen 932 (step224). The system detects whether the user retrieves an existing entry(step 226); if not, the system creates a new entry (step 228).Otherwise, if the user had retrieved an existing entry, the systemretrieves the requested entry from the database and displays it such asis shown in entry section 934 (step 230). The user may then enterinformation or edit previously-entered information and close thenotebook entry (step 232). The system stores the entry in the databasefor the user's notebook (step 234). The notebook may generate entries inthe same manner as the electronic journal described above;alternatively, a user may create or delineate their own notebookentries.

Webliography^(SM) Feature

The webliography feature permits the display and exchange of researchinformation from the Internet or other sources. For example, users mayexchange various hypertext links illustrating sources of informationrelevant to an on-line educational course. The term “webliography” is aservice mark of eCollege.com.

FIG. 3K is a diagram of a webliography screen 938. Webliography screen938 includes index section 816 as explained above. Webliography screen938 also has a number of sections for viewing entries for thewebliography feature, adding entries, and searching for entries.Selection of an add section 940 permits a user to add an entry,selection of an entry section 942 permits the user to view all entries,and selection of a search section 944 permits the user to search forentries. Upon searching or requesting to view entries, the systemdisplays entries as follows, for example: a section 946 identifies afirst entry and a section 948 provides a description for the firstentry; and a section 950 identifies a second entry and a section 948provides a description for the second entry.

FIG. 1I is a flow chart of a method 236, using webliography screen 938,for implementing a webliography feature for an on-line educationalsystem. Webliography method 236 may use at least Tables 686 and 688 inthe database. In method 236, the instructor or user selects webliographyselection 838 in the course home page (step 238). In response, thesystem displays a webliography section such as webliography screen 938(step 240). The system then receives a requested function from the useror instructor (step 242).

For example, the following functions may be provided for thewebliography feature. If the system receives an add link functionthrough selection of add section 940 (step 244), it receives and storesthe entered link (step 246). A link may be a hypertext link providing anetwork address of particular content. If the system receives an editthread function through selection of entry section 942 (step 248), itreceives and stores the information to edit the thread. If the systemreceives a search function through selection of search section 944 (step252), it performs the requested search (step 254). If the systemreceives an add comment function through selection of an entry (step256), it receives and stores a particular comment (step 258). The systemmay also receive other functions (step 260) and execute those functions(step 262).

After receiving and executing the requested function, the systemdisplays the results of the executed function (step 264). The system mayrepeatedly execute functions for instructor or user until it detectsthat the instructor or user has closed the webliography section orscreen 938 (step 266).

Threaded Discussion

A threaded discussion permits instructors and users to maintain anon-line discussion in non-realtime by posting messages responding toparticular topics and viewing the posted messages. For example, aninstructor may enter a particular topic for discussion, and users whenthey log on to the system may enter information for that topic andcontinue the discussion.

FIG. 3L is a diagram of a threaded discussion screen 954. Threadeddiscussion screen 954 has index section 816 as explained above. Sections956 and 958 identify topics for discussion, typically entered by aninstructor. A message section 960 provides a message for topic 958.Users may respond to the topic by selecting a response section 962.Users may display responses to topics according to a particular topic byselecting a topic section 968. Responses to topics may be displayedaccording to date by selecting a date section 970. Responses to topicsmay be displayed according to author by selecting an author section 972.A section 974 provides an example of a response to a topic, and a usermay respond to the topic by selecting section 976 and entering aresponse in a corresponding section. Authorized personnel may edit atopic by selecting a section 964, delete the topic by selecting asection 966, and delete a posted response by selecting section 978.

FIG. 1J is a flow chart of a threaded discussion method 268, usingthreaded discussion screen 954, for an on-line educational system.Threaded discussion method 268 may use at least Table 700 in thedatabase. In method 268, an instructor or user selects threadeddiscussion selection 841 in the course home page (step 270). Inresponse, the system displays a threaded discussion section such asthreaded discussion screen 954 with existing comments such as is shownin message section 960 (step 272). The instructor or user may then entera comment and the system receives the comment (step 274). The systemassociates the comment with the threaded discussion, displays thecomment and stores it in the database for access by other users in thecourse (step 276).

Grading

An exam question feature of the on-line educational system provides foron-line testing of users. The educational system includes providingon-line content concerning educational materials for a particulareducational course, and providing on-line an electronic syllabus for theeducational course. The apparatus provides on-line to the users examquestions with multimedia content, and receives on-line answers to theexam questions. An on-line exam includes any type of on-line way toevaluate a user taking an on-line course. The exam may include bothobjective and subjective questions, as explained below.

The exam question feature may include various other aspects. Forexample, it may automatically grade the answers to generatecorresponding grade information, and it may store the grade informationin an on-line gradebook. The users may be selectively provided withaccess to the grade information in the on-line gradebook. If the answersrequire manual grading by an instructor, the apparatus transmits theanswers to the instructor or at least the answers requiring manualgrading, and it receives from the instructor grade information for theanswers. The instructor may also include comments concerning the gradeinformation. The instructor's grade information and comments generatedthrough manual grading may also be included in the on-line gradebookwith access selectively provided to the corresponding users.

A grading screen electronically displays information for use inproviding exam questions to users for the on-line educational system.The screen includes an index section for selecting a home page screenhaving a content section identifying on-line content concerningeducational materials for a particular educational course and having asyllabus section for providing an electronic syllabus for theeducational course. An exam question section in the screen provideson-line to the users exam questions with multimedia content and receiveson-line answers to the exam questions.

FIG. 3M is a diagram providing an example of a grading or exam screen980. Exam screen 980 provides an example of how a user may take anon-line exam. Exam screen 980 includes a timer section 982 displaying atime remaining for the exam. Two exemplary questions are shown for theexam. An exam question section 984 displays a true/false type question,and an exam question section 986 displays a section requiring thematching of words with the correct definitions. A user may selectsections 988 to view and complete additional portions of the exam. Theuser stores the enter answers by selecting a store section 990, andsubmits the answers for grading by selecting a submit section 992.

The on-line exam in screen 980 may include both objective and subjectivequestions. For example, objective questions may include the following:true/false questions such as the type shown in exam question section984; matching questions such as the type shown in exam question section986; and multiple choice questions. Subjective questions may includeessay questions; fill in the blank questions; and short answerquestions. Answers to the objective questions may be automaticallygraded by the system by comparing the answers to stored correct answers,and answers to the subjective questions may be transmitted to aninstructor for manual grading. On-line exams may be created using acourse manager feature as described below.

FIG. 1K is a flow chart of a grading method 278, using exam screen 980,for an on-line educational system. Grading method 278 may use at leastthe following tables in the database: Tables 684, 694, 696, 698, 702,706, 708, 710, 712, and 716. On-line grading for an on-line educationalsystem permits users to take exams on-line and those exams may be gradedautomatically or sent to instructors for grading. The system receives auser's request for an exam (step 280). A user may request an exam byselecting one in the electronic syllabus in syllabus section 806 afterhaving been posted by an instructor. The system retrieves thecorresponding exam and displays it to the user such as is shown in examscreen 980 (step 282). Also, the system may start an optional timer tolimit the amount of time the user is permitted to take the exam anddisplay the time remaining in timer section 982 (step 284).

The system receives the user's answers to the exam, such as through examquestion sections 984 and 986 (step 286). It permits the user tocontinue entering answers until the timer has expired (step 288) or theuser closes the exam (step 290). Upon detecting one of the events endingthe exam such as a time-out or selection of submit section 992, thesystem closes the exam and stores the user's answers in the database(step 292).

The system determines if automatic grading has been invoked (step 294).For example, for multiple choice exams, the system may automaticallygrade the exam. If automatic grading has been invoked, the system gradesthe user's answers and scores the grade information in the database(step 300). It also determines if any instructor grading is required forthe user's answers (step 302). If not, the system posts the gradeinformation in the on-line gradebook (step 304).

If automatic grading is not invoked or if any portion of the examrequires instructor grading, the system transmits the user's answers tothe instructor for grading (step 296). The system receives gradeinformation from the instructor along with optional comments and storesthat information in the database (step 298) and then posts the gradeinformation in the on-line gradebook (step 304).

Administrative Pages/Functions

An administrative pages feature of the on-line educational systemprovides on-line administrative functions for users. The educationalsystem includes providing on-line content concerning educationalmaterials for a particular educational course, and providing on-line anelectronic syllabus for the educational course. The apparatus providesinformation, accessible on-line by the users, concerning administrativefunctions related to the educational course. Administrative pages arescreens providing for administrative functions on-line courses.Administrative functions are procedural or other matters relating anon-line course but not necessarily relating to the substantive contentof the course. Examples of administrative functions are provided below.

The administrative pages feature may include various other aspects. Forexample, the information available via the administrative pages mayinclude an enrollment for a particular user, a registration history fora particular user, payment by a particular user, a report havinginformation identifying a particular user, and a report havinginformation identifying a particular course. The administrative pagesmay also provide for searching for information related to a particularuser based upon user-entered information.

An administrative screen electronically displays information for use inproviding administrative pages for the on-line educational system. Thescreen includes an index section for selecting a home page screen havinga content section identifying on-line content concerning educationalmaterials for a particular educational course and having a syllabussection for providing an electronic syllabus for the educational course.An administrative section in the screen provides information, accessibleon-line by users of the system, concerning administrative functionsrelated to the educational course.

FIG. 3N is a diagram providing an example of an administrative pagesscreen 994. Administrative pages screen 994 lists various administrativefunctions in administrative sections 996, 1006, and 1012 for selectionby a user or other person in order to access additional screens. Forexample, administrative section 996 lists user maintenance selections,including a user enrollment selection 998, a user status selection 1000,a create user selection 1002, and an enrollment selection 1004.Administrative section 1006 lists administrative message centerselections, including a send message selection 1008 and a remove courseblock selection 1010. Administrative section 1012 lists reportsselections, including a user reports selection 1014, a course reportsselection 1015, and a university reports selection 1016.

A user may select selections 998, 1000, 1002, and 1004 to accessadditional screens relating to user maintenance. User enrollmentselection 998 produces a screen 1018, shown in FIG. 3O, providing asection 1020 listing user enrollment. Status selection 1000 produces ascreen 1022, shown in FIG. 3P, including a section 1024 listing statusof a particular user selected from a section 1026 listing enrollment ofusers. Screen 1022 also includes a section 1028 for a user to select inorder to update entered information. Enrollment selection 1004 producesa screen 1030, shown in FIG. 3Q, including sections for enrolling a userin another area. In particular, screen 1030 includes a section 1032identifying a user's enrollment; a section 1034 to select a newenrollable area for the user; a section 1036 to select the user's rollin the new area; a section 1038 to move the user into the selected areaonly; and a section 1040 to remove the user from the currently enrolledareas.

A user may select section 1008 to access a screen 1042, shown in FIG.3R, for an administrative message center. An authorized person may usescreen 1042 in order to send a message to various users among multiplecourses. Section 1044 is used to enter an e-mail address of the sender.Section 1046 is used to enter a message subject. Section 1048 is used toenter an e-mail message. The sender may select recipients of the e-mailmessage by selecting users listed in section 1052, and the message istransmitted to the selected users by selecting section 1050. Section1052 typically lists all users in all courses.

A user may select selections 1014, 1015, and 1016 to access additionalscreens relating to reports. Selection 1014 produces a screen 1054,shown in FIG. 3S, including a section 1056 providing a report for aparticular user. Selection 1015 produces a screen 1058, shown in FIG.3T, including a section 1060 providing status of a particular course anda section 1062 providing a course report. Selection 1016 produces ascreen 1064, shown in FIG. 3U, including a section 1066 providing auniversity report.

The home page may include a link to the administrative pages forselection by an instructor, user, or other person. In addition, sendingmessages to users among multiple courses may be accomplished with themessage center described with respect to FIGS. 1E and 3G, or with theadministrative message center shown in screen 1042 (FIG. 3R).

Use of administrative pages is further explained in the AdministrativePages Guide included in Appendix B.

FIG. 1L is a flow chart of an administrative pages method 306, using thescreens shown in FIGS. 3N-3U, for an on-line educational system.Administrative pages method 306 may use at least the following tables inthe database: Tables 508, 512, 528, and 574. In method 306, the systemdetects whether user maintenance is required (step 308). If usermaintenance is required, the system provides the requested maintenance(step 310), which may include the following: status information (step312); enrollment information (step 314); registration historyinformation (step 316); payment information (step 318); or other type ofmaintenance information (step 320). FIGS. 3O-3Q are screens forproviding maintenance information as follows: FIG. 3O is a diagram of anenrollment status screen 1018; FIG. 3P is a diagram of a user statusscreen 1022; and FIG. 3Q is a diagram of an enrollment screen 1030.

The system also detects whether a report is requested (step 322). If thereport is requested, the system provides the requested report (step324), which may include the following: a user report (step 326); acourse report (step 328); a university report (step 330); or other typeof report (step 332). FIGS. 3S-3U are screens for report information asfollows: FIG. 3S is a diagram of a user report screen 1054; FIG. 3T is adiagram of a course report screen 1058; and FIG. 3U is a diagram of auniversity report screen 1064.

The system also detects whether other types of administrative functionsare requested (step 334). If so, it provides the other requestedfunctions (step 336), which may include the following: send messagefunction (step 338); remove course block function (step 340); a searchfunction (step 342); or other function (step 334). FIG. 3R is a diagramof an administrative message screen 1042 for sending a message in step338 as described above. The system also determines whether morefunctions have been requested (step 346) and, if so, may repeat method306.

Course Manager

A course manager feature permits an instructor to develop an on-linecourse for the on-line educational system. The apparatus receives fromthe instructor an identification of units each representing portions ofan educational course, an identification of assignments for the units,and an identification of educational materials for the units. Theapparatus compiles the units, the assignments, and the educationalmaterials into an on-line electronic syllabus for the educationalcourse.

The course manager feature may include various other aspects. Forexample, an instructor may enter the following for assignments: athreaded discussion assignment; a reading assignment; a lectureassignment; an indication of a file to be downloaded; an addressidentifying a network location of additional content for the educationalcourse; a journal assignment; and a webliography assignment. Theeducational materials entered by the instructor may include audio,video, multimedia information, or any of the types of informationidentified above. The instructor may also enter on-line exams to betaken by users enrolled in the course. In addition, the instructor editthe identification of the units, the identification of the assignments,or the identification of the educational materials in preparing theelectronic syllabus. The course manager may also permit selectivelyproviding on-line access to the electronic syllabus by the users.

A course manager screen electronically displays information for use inpermitting an instructor to develop an on-line course for the on-lineeducational system. The screen includes a unit section for receiving anidentification of units each representing portions of an educationalcourse, an assignment section for receiving an identification ofassignments for the units, and a content section for receiving anidentification of educational materials for the units. A syllabussection in the screen illustrates a compilation of the units, theassignments, and the educational materials into an on-line electronicsyllabus for the educational course. The syllabus section may includeicons identifying the assignments. The course manager screen may alsoinclude an access section for selectively providing on-line access tothe electronic syllabus by the users.

FIGS. 3V-3X are diagrams providing examples of screens for supporting acourse manager. In particular, FIG. 3V is a diagram of a course managerscreen 1068. An instructor may use course manager screen 1068 in orderto build an electronic syllabus for an on-line educational course.Course manager screen 1068 includes an electronic syllabus 1070identifying units and assignments for a particular course. A unitsection 1072 identifies units for the course; in this example the courseis divided into weekly units. A date section 1074 identifies the datesfor each unit in unit section 1072. A content or assignment section 1076identifies educational content and the assignments to be completed foreach of the units in unit section 1072. In this example the content andassignments are identified by icons, and course manager screen 1068 mayinclude a key explaining the meanings of the icons such as key section814 shown in home page screen 800 (FIG. 3A).

Course manager screen 1068 also includes a tree section 1069illustrating content for the course in a tree-type structure; inparticular, the structure identifies the units for the course and shows,linked to the units, the corresponding assignments for each unitidentified by icons and textual descriptions. Tree section 1069 thusprovides an instructor with an outline for the course.

FIG. 3W is a diagram of a course manager unit screen 1078, providingmore detail for the particular units in unit section 1072 in coursemanager screen 1068. Course manager unit screen 1078 includes a section1080 for an instructor to select particular units of a course. Uponselecting a unit, a section 1082 displays detail for that unit, in thisexample unit 2. The detail may include identification of the unit, datesof the unit, and information describing assignments for the unit.

FIG. 3X is a diagram of an add content screen 1084 for a course manager.An instructor uses add unit screen 1084 to add or modify content forparticular units of a course and thus build the syllabus for the course.Selection of a unit in syllabus 1070 may produce add content screen 1084and permit the instructor to modify or create that unit. An add linksection 1086 permits the instructor to add a link to a document, image,or web page for the unit. An add section 1088 permits the instructor toadd or modify content for the unit such as identification anddescription of assignments for the unit. Selecting save section 1090saves the entered information and closes add content screen 1084, andselecting cancel section 1092 closes add content screen 1084 withoutsaving the entered information or modifying the unit.

Building of courses is further explained in the Course Manager Guideincluded in Appendix C.

FIG. 1M is a flow chart of a course manager method 348, using thescreens shown in FIGS. 3V-3X, for an on-line educational system. Coursemanager method 348 may use at least the following tables in thedatabase: Tables 582, 594, 596, 602, 626, 662, 682, 684, and 692. Inmethod 348, the instructor or user selects the course manager (step350). Home page 800 may include a section for selecting the coursemanager. The system determines if the instructor has selected thefunction, since the system limits access to the course manager toinstructors for building courses (step 352). If an instructor hasrequested the function, or another person permitted access to it, thesystem receives identification of units for a particular course as shownin section 1070 (step 354).

The system also receives identification of assignments and educationalmaterials for the course, such as through add content section 1084 (step356). The assignments and educational content may include one or more ofthe following: a threaded discussion (step 358); a reading (step 360); alecture (step 362); a file (step 364); a hyper-text link (step 266); orother assignment information (step 368). The instructor may enter theassignments and educational materials through screen 1084, for example,using add section 1088; the same section may be used for adding bothassignments and content. Threaded discussions are explained above. Areading assignment involves textual material, possibly with otherinformation, for reading or viewing by a user. A lecture involves audioor audiovisual information for access by a user; for example, aninstructor may record an audio lecture or audiovisual lecture and makethe lecture available to users on-line. A file involves a document to beshared with a user. A hyper-text link involves a network address ofinformation to be accessed by the user; for example, it may be a UniformResource Locator (URL) for accessing information on the World Wide Web.

The Course Manager Guide in Appendix C further explains adding units,content, and assignments, along with exemplary screens for receivingthat information.

The system determines if the instructor enters more assignments (step370) and, if so, it repeats step 356 to receive identification ofadditional assignments and educational materials. Otherwise, the systemdetermines if the instructor has requested an exam (step 372). If so,the system receives and compiles exam information (step 374). Examinformation may include on-line exams, an example of which is providedabove. An instructor or other person may enter information to create anon-line exam as described in the Course Manager Guide in Appendix C.

The system also determines if the instructor wants to edit any of thepreviously-entered information (step 376). The instructor may repeatvarious steps in method 348 to edit the information.

When the instructor has finished entering the information for thecourse, the system compiles the units, assignments and educationalmaterials into an electronic syllabus for the course (step 378).Compiling the information involves placing it in form for storage withinan electronic syllabus and for on-line access by users; an examples ofsuch an electronic syllabus is provided above. The system then storesthe compiled information on the database for access by users enrolled inthe on-line course.

While the present invention has been described in connection with anexemplary embodiment, it will be understood that many modifications willbe readily apparent to those skilled in the art, and this application isintended to cover any adaptations or variations thereof. For example,different labels for the various features, screen sections, and methods,and different types of servers, instructor machines, and user machinesmay be used without departing from the scope of the invention. Thisinvention should be limited only by the claims and equivalents thereof.

What is claimed is:
 1. A method for providing exam questions to usersand an electronic journal for use with an on-line educational system,comprising: providing on-line content concerning educational materialsfor a particular educational course; providing on-line an electronicsyllabus for the educational course; providing on-line to the users examquestions with multimedia content for the on-line exam; receivingon-line answers to the exam questions; providing an electronic journalfor a particular one of the users permitting the particular user toenter information into the electronic journal for participation in theeducational course, wherein the electronic journal provides forassociation of the entered information with the particular user;permitting the instructor to enter information into the electronicjournal for viewing by the particular user, wherein the electronicjournal provides for secure access to the instructor's enteredinformation by the particular user; permitting the user to selectivelyidentify permitted access to the electronic journal by the instructor;and selectively providing access to the electronic journal by theinstructor based upon the particular user's identification of permittedaccess.
 2. The method of claim 1, further including automaticallygrading the answers to generate corresponding grade information.
 3. Themethod of claim 2, further including storing the grade information in anon-line gradebook.
 4. The method of claim 2, further includingselectively providing the user with access to the grade information inthe on-line gradebook.
 5. The method of claim 1, further includingtransmitting the answers to an instructor.
 6. The method of claim 5,further including receiving from the instructor grade information forthe answers.
 7. The method of claim 6, further including receiving fromthe instructor comments concerning the grade information.
 8. The methodof claim 6, further including storing the grade information in anon-line gradebook.
 9. The method of claim 8, further includingselectively providing the user with access to the grade information inthe on-line gradebook.
 10. The method of claim 1, further including:triggering a timer upon receiving an indication of a user's request tobegin the on-line exam; and limiting acceptance of the on-line answersto a time period beginning with the triggering of the timer and endingwith expiration of the timer.
 11. The method of claim 10, furtherincluding displaying to the user an indication of a time remaining onthe timer.
 12. An apparatus for providing exam questions to users and anelectronic journal for use with an on-line educational system,comprising: a content module for providing on-line content concerningeducational materials for a particular educational course; a syllabusmodule for providing on-line an electronic syllabus for the educationalcourse; an exam module for providing on-line to the users exam questionswith multimedia content for the on-line exam; an answer module forreceiving on-line answers to the exam questions; a journal module forproviding an electronic journal for a particular one of the userspermitting the particular user to enter information into the electronicjournal for participation in the educational course, wherein theelectronic journal provides for association of the entered informationwith the particular user; an instructor module for permitting theinstructor to enter information into the electronic journal for viewingby the particular user, wherein the electronic journal provides forsecure access to the instructor's entered information by the particularuser; an access module for permitting the user to selectively identifypermitted access to the electronic journal by the instructor; and amodule for selectively providing access to the electronic journal by theinstructor based upon the particular user's identification of permittedaccess.
 13. The apparatus of claim 12, further including a module forautomatically grading the answers to generate corresponding gradeinformation.
 14. The apparatus of claim 13, further including a modulefor storing the grade information in an on-line gradebook.
 15. Theapparatus of claim 14, further including a module for selectivelyproviding the user with access to the grade information in the on-linegradebook.
 16. The apparatus of claim 12, further including a module fortransmitting the answers to an instructor.
 17. The apparatus of claim16, further including a module for receiving from the instructor gradeinformation for the answers.
 18. The apparatus of claim 17, furtherincluding a module for receiving from the instructor comments concerningthe grade information.
 19. The apparatus of claim 17, further includinga module for storing the grade information in an on-line gradebook. 20.The apparatus of claim 19, further including a module for selectivelyproviding the user with access to the grade information in the on-linegradebook.
 21. The apparatus of claim 12, further including: a modulefor triggering a timer upon receiving an indication of a user's requestto begin the on-line exam; and a module for limiting acceptance of theon-line answers to a time period beginning with the triggering of thetimer and ending with expiration of the timer.
 22. The apparatus ofclaim 21 further including a module for displaying to the user anindication of a time remaining on the timer.
 23. A computer programproduct, comprising: a computer-readable medium containing instructionsfor controlling a computer system to perform a method for providing examquestions to users and an electronic journal for use with an on-lineeducational system, the method including: providing on-line contentconcerning educational materials for a particular educational course;providing on-line an electronic syllabus for the educational course;providing on-line to the users exam questions with multimedia contentfor the on-line exam; receiving on-line answers to the exam questions;providing an electronic journal for a particular one of the userspermitting the particular user to enter information into the electronicjournal for participation in the educational course, wherein theelectronic journal provides for association of the entered informationwith the particular user; permitting the instructor to enter informationinto the electronic journal for viewing by the particular user, whereinthe electronic journal provides for secure access to the instructor'sentered information by the particular user; permitting the user toselectively identify permitted access to the electronic journal by theinstructor; and selectively providing access to the electronic journalby the instructor based upon the particular user's identification ofpermitted access.
 24. The computer program product of claim 23, furtherincluding automatically grading the answers to generate correspondinggrade information.
 25. The computer program product of claim 24, furtherincluding storing the grade information in an on-line gradebook.
 26. Thecomputer program product of claim 25, further including selectivelyproviding the user with access to the grade information in the on-linegradebook.
 27. The computer program product of claim 23, furtherincluding transmitting the answers to an instructor.
 28. The computerprogram product of claim 27, further including receiving from theinstructor grade information for the answers.
 29. The computer programproduct of claim 28, further including receiving from the instructorcomments concerning the grade information.
 30. The computer programproduct of claim 28, further including storing the grade information inan on-line gradebook.
 31. The computer program product of claim 30,further including selectively providing the user with access to thegrade information in the on-line gradebook.
 32. The computer programproduct of claim 23, further including: triggering a timer uponreceiving an indication of a user's request to begin the on-line exam;and limiting acceptance of the on-line answers to a time periodbeginning with the triggering of the timer and ending with expiration ofthe timer.
 33. The computer program product of claim 32, furtherincluding displaying to the user an indication of a time remaining onthe timer.